logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE LTD
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, UK. HA4 7AE
RHAPSODE LTD
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, UK. HA4 7AE

'validity and reliability of survey' Search Results



...

This study aims to conduct Turkish adaptation, validity and reliability studies of the Teacher Rating Scales of Early Academic Competence. This study also aims to examine and improve early academic competence thoroughly on the basis of teachers’ ratings in Turkey, and lastly to contribute an assessment and measurement instrument to the literature which will enable to conduct further research in the field. This study was designed in a general survey model. The study included normally developing 619 36-72 month-old preschoolers attending to nursery classes and kindergartens affiliated to Afyonkarahisar Ministry of National Education in 2015-2016 academic year. The validity and reliability studies of the data obtained following the implementation of TRS-EAC, was completed. The Cronbach Alpha, split half test, test-retest reliability of the scale and its subscales were measured. TRS-EAC was found to be valid and reliable for 36-72 month-old children. It can be considered that the various studies that can be used TRS-EAC in Turkey will provide important contributions to the measurement power of this test.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.1.43
Pages: 43-57
cloud_download 557
visibility 799
2
Article Metrics
Views
557
Download
799
Citations
Crossref
2

Scopus

...

Computational thinking is a way of thinking that covers 21st century skills and includes new generation concepts such as robotics, coding, informatics and information construction. Computational thinking has reached an important point especially in the field of science in line with the rapid developments in technology. Robotics applications, software-based activities, STEM (Science, Technology, Engineering, Math) education and problem-based studies are some of the areas where this thinking is used. In this study, which is based on this point, it is aimed to develop a scale for computational thinking. Exploratory sequential design, one of the mixed research methods, was used in the study. First of all, a detailed literature review was conducted and needs analysis was carried out. This study consists of two stages. In the first stage, exploratory factor analysis was performed and analyzed with SPSS 23 program. In the second stage, confirmatory factor analysis was performed and analyzed with LISREL 9.2 program. As a result of the study, the goodness of fit indexes of the scale was found. According to this; X2/df value 1.81; NNFI value 0.97; NFI value 0.93; CFI value 0.98; RMR value 0.05; SRMR value 0.04; AGFI value 0.91 and GFI value was found to be 0.93. When the reliability values of the study were examined, Cronbach’s Alpha value was found to be 0.86. As a result of the research, a computational thinking scale consisting of 3 factors and 30 items was developed. This scale was developed for prospective teachers and can be used at all levels of prospective teachers.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.3.421
Pages: 421-432
cloud_download 1788
visibility 1796
5
Article Metrics
Views
1788
Download
1796
Citations
Crossref
5

Scopus

...

Positive attitude towards statistics is a desirable aspect in developing statistical thinking and understanding statistical concept. The attitude towards statistics instrument in previous study on rural school students lacked evidence in the validity analysis. Therefore, there is a need to provide a valid instrument that can assess rural secondary school students’ attitude toward statistics. For this purpose, this study was carried out to investigate the validity and reliability analysis of the Survey Attitude towards Statistics (SATS-36) instrument from a sample of rural secondary school students. The SATS-36 is a 7-point Likert type scale questionnaire, used to measure students’ attitude towards statistics. The SATS-36 instrument was distributed to 217 Tenth grade science stream students from a rural district in Sabah, Malaysia, which comprised of 66 (30.4%) boys and 151 (69.6%) girls. A second order Confirmatory Factor Analysis (CFA) was carried out to analyze the validity of the SATS-36 instrument as well as to confirm the 6-factor model of SATS-36. The reliability of SATS-36 instrument was assessed through the Cronbach’s Alpha value. Overall, the analysis showed that the SATS-36 instrument shows favorable indices for both its validity and reliability. Thus, it can be concluded that the SATS-36 was a valid and reliable instrument for measuring students’ attitude towards statistics among rural science stream secondary school students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.4.651
Pages: 651-661
cloud_download 1113
visibility 1555
16
Article Metrics
Views
1113
Download
1555
Citations
Crossref
16

Scopus
14

...

Within the scope of the research, which aims to determine the leisure literacy and leisure exercise levels of the university students who volunteer in sports organizations, it is aimed to analyze the relationship and the differences of certain variables with measurement tools, as well as to examine the relationship and impact between leisure literacy and leisure exercise. In this context, 207 sports organization volunteers who participated in the study participated in the data collection, as well as a demographic information form, as well as the “Leisure Literacy Scale” and “Leisure-Time Exercise Scale" was used. In this study, the internal reliability coefficient for the Leisure literacy scale was .94 and .70 for the leisure exersice questionnaire. Descriptive statistics, independent sample t test, one-way analysis of variance (ANOVA) test and Tukey (HSD-LSD) test and Pearson Correlation test and regression analysis were used for data analysis. The findings reveal that participants have high leisure literacy (81.25 ± 14.04) and men exhibit more active leisure exercise levels, certain variables change leisure literacy and leisure exercise levels. On the other hand, positive strong relationships between leisure literacy and leisure exercise were determined, and leisure literacy was found to have a positive effect on leisure exercise level. As a result of the research, it can be stated that the volunteer participants who take part in sports organizations and evaluate their leisure time actively, the literacy knowledge, background and action level for their leisure time is an important factor that makes individuals spend their leisure by exercising.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.2.381
Pages: 381-392
cloud_download 956
visibility 814
9
Article Metrics
Views
956
Download
814
Citations
Crossref
9

Scopus
5

...

Motivation for school is an important concept which influences students’ academic, social and cultural development. Leadership behaviours to be displayed by school principals can be thought to affect the network of social relations in school and to support the climate of trust in school for students to develop positive attitudes towards the school. In this context, this paper aims to analyse the correlations between school principals’ social justice leadership behaviours, students’ trust in school principals and motivation for school. The study group was composed of 762 secondary school students from Altindag district of Ankara. The data were collected with social justice leadership scale, trust in the school principal scale and motivation for the school scale. The data were put to descriptive analysis, correlation analysis and multiple linear regression analysis. The findings demonstrated that students had moderate level of perceptions of school principals’ social justice leadership behaviours and trust in school principals and high level of motivation for school. Besides, significant correlations were also found between the variables. Additionally, it was found that social justice leadership predicted significantly trust in school principals and motivation for school. The findings showed that the social justice leadership behaviors of the school principal play a key role on students’ motivation and their trust in the principals.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.4.775
Pages: 775-788
cloud_download 960
visibility 988
0
Article Metrics
Views
960
Download
988
Citations
Crossref
0

Scopus

...

Time management for educational leaders has remained highly relevant to scholars, policymakers and practitioners. We analyzed survey responses from 98 public high school principals to examine the congruency between average total hours they worked per week against the sum total of the average hours worked per week in each of five distinct categories of leadership tasks. The observed congruence was 0.32, while Cohen’s kappa coefficient was 0.10. Female principals tended to underreport, and male principals tended to overreport, total work time. Principals with doctorate degrees exhibited higher congruence than those without, and overreporting was inversely related to highest degree. Principals in charge of large teaching staffs were more likely than their counterparts to be congruent and less likely to overreport total work time. Self-report appears to be an inaccurate method to measure time use among high school principals. If time use is a key component of the quality of principal leadership, more detailed and robust techniques for collecting time use data should be utilized in future studies.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.1.53
Pages: 53-65
cloud_download 389
visibility 616
0
Article Metrics
Views
389
Download
616
Citations
Crossref
0

Scopus

...

The aim of the research was to investigate the relation between middle school students' perceptions of school climate and school motivation, whether school climate perceptions have a significant power on school motivation as well as to see if those perceptions and motivation differ significantly depending on gender, grade level, and school location variables. The sample of the study consisted of 674 middle school students studying in two state schools, which were located in the central district and village in Kosk province in Aydin in Turkey. Data were collected by using School Climate Perceptions Scale and School Motivation Scale with three questioned personal information form. Results showed that there were significant medium-level correlations between school climate perceptions and school motivation of middle school students. While grade-level variables had significant differences in both school climate perceptions and school motivation of middle school students, the location did not create a difference. On the other hand, gender had a significant difference only with school motivation. Finally, the model tested student-teacher relation significantly predicted 18% of the school motivations of middle school students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.2.361
Pages: 361-372
cloud_download 397
visibility 609
0
Article Metrics
Views
397
Download
609
Citations
Crossref
0

Scopus

...

This study aims to develop a learning model based on 4C skills to improve high school students’ mathematical critical thinking skills. Research & development is the design used in this research by applying Plomp’s development theory which consists of three phases, namely needs analysis, design and implementation, and evaluation. This research was conducted at Madrasah Aliyah Negeri 2 Parepare, South Sulawesi, Indonesia involving five experts, four teachers, and 20 students. Data collection and analysis were carried out qualitatively and quantitatively. Analysis of interviews’ data and observations qualitatively with the thematic analysis technique. We also analyse data from validation sheets, questionnaires, and mathematical essay tests with the help of SPSS 20.00. The results show that students and lecturers need a learning model to improve mathematical critical thinking skills. In addition, other findings stated that the learning model developed was proven to be valid, practical, and effective to be used in general. Developing your learning model can further improve students' learning outcomes and mathematical critical thinking skills because they are designed based on the actual needs and problems. For this reason, a teacher must be able to design his learning model.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.3.493
Pages: 493-504
cloud_download 514
visibility 787
2
Article Metrics
Views
514
Download
787
Citations
Crossref
2

Scopus
2

...

This study reviews 60 papers using a Likert scale and published between 2012 – 2021. Screening for literature review uses the PRISMA method. The data analysis technique was carried out through data extraction, then synthesized in a structured manner using the narrative method. To achieve credible research results at the stage of the data collection and data analysis process, a group discussion forum (FGD) was conducted. The findings show that only 10% of studies use a measurement scale with an even answer choice category (4, 6, 8, or 10 choices). In general, (90%) of research uses a measurement instrument that involves a Likert scale with odd response choices (5, 7, 9, or 11) and the most popular researchers use a Likert scale with a total response of 5 points. The use of a rating scale with an odd number of responses of more than five points (especially on a seven-point scale) is the most effective in terms of reliability and validity coefficients, but if the researcher wants to direct respondents to one side, then a scale with an even number of responses (six points) is possible. more suitable. The presence of response bias and central tendency bias can affect the validity and reliability of the use of the Likert scale instrument.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.625
Pages: 625-637
cloud_download 1336
visibility 2146
9
Article Metrics
Views
1336
Download
2146
Citations
Crossref
9

Scopus
4

Rethinking the Components of Regulation of Cognition through the Structural Validity of the Meta-Text Test

metacognition performance-based testing regulation of cognition structural validity

Marcio Alexander Castillo-Diaz , Cristiano Mauro Assis Gomes , Enio Galinkin Jelihovschi


...

The field of studies in metacognition points to some limitations in the way the construct has traditionally been measured and shows a near absence of performance-based tests. The Meta-Text is a performance-based test recently created to assess components of cognition regulation: planning, monitoring, and judgment. This study presents the first evidence on the structural validity of the Meta-Text, by analyzing its dimensionality and reliability in a sample of 655 Honduran university students. Different models were tested, via item confirmatory factor analysis. The results indicated that the specific factors of planning and monitoring do not hold empirically. The bifactor model containing the general cognition regulation factor and the judgment-specific factor was evaluated as the best model (CFI = .992; NFI = .963; TLI = .991; RMSEA = .021). The reliability of the factors in this model proved to be acceptable (Ω = .701 & .699). The judgment items were well loaded only by the judgment factor, suggesting that the judgment construct may actually be another component of the metacognitive knowledge dimension but having little role in cognition regulation. The results show initial evidence on the structural validity of the Meta-Text and give rise to information previously unidentified by the field which has conceptual implications for theorizing metacognitive components.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.8.4.687
Pages: 687-698
cloud_download 287
visibility 568
2
Article Metrics
Views
287
Download
568
Citations
Crossref
2

Scopus
1

...

The purpose of the study is to explore the ways of involving university stakeholders specifically in updating educational services. It combined exploratory and observational research methods which relied on qualitative or quantitative data gathered through the researcher-designed and validated tools which were the empirical and methodological contributions to the previous research. The five most frequent choices that might encourage the stakeholders to donate or invest in an educational institution were as follows: a portfolio of the use of donations, investments, or grants, having a stake in the educational services of more than 7%, having access to budgeting and cost reporting, having a share in the institutions’ profit and being one of the decision-makers. The factors that discouraged investors from investing in education were as follows: distrust of the activity of the educational institutions in terms of addressing the stakeholders’ needs or interests, lack of engagement or cooperation, institutional and government-imposed barriers between them and the institutions, uncertainty concerning the efficiency of the institutions and inefficient use of the resources by the institutions. The initiative was complimentarily perceived by stakeholders in terms of collaboration and investment opportunities. It was also found beneficial by the sampled students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.1.107
Pages: 107-122
cloud_download 223
visibility 471
4
Article Metrics
Views
223
Download
471
Citations
Crossref
4

Scopus
0

The Pedagogical Role of the Primary-School Headteacher: Insights From Greece

headteacher pedagogical leadership school principal school climate school life

Nikolaos Alexopoulos , Thomas Babalis , Konstantina Tsoli , Stavroula Delioridou


...

The pedagogical and didactic guidance of teachers has been linked, in the relevant literature, to the school management’s adoption of the model of pedagogical leadership as well as to the assurance of a series of factors that influence it. This study aims at investigating the pedagogical role of the principal in Greek primary schools. Data were collected through an anonymous questionnaire completed by 133 Greek primary school head teachers. Results show that head teachers consider that their pedagogical role has mainly to do with the pedagogical climate, psychosocial and pedagogical guidance of the school unit. Additionally, the research results show that head teachers carry out their pedagogical role cooperating and communicating mainly with the members of the educational community of the school. Another noteworthy finding of the present study is that the factors that support head teachers in their pedagogical leadership role, are hard to exist in hierarchical educational realities such as Greece. The originality of the paper draws attention to the school's socio-economic environment, which significantly influences school leadership. Conclusions on the implications of the study are made and directions for future research are suggested.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.9.3.535
Pages: 535-549
cloud_download 209
visibility 382
0
Article Metrics
Views
209
Download
382
Citations
Crossref
0

Scopus
0

...

The role of artificial intelligence (AI) in education remains incompletely understood, demanding further evaluation and the creation of robust assessment tools. Despite previous attempts to measure AI's impact in education, existing studies have limitations. This research aimed to develop and validate an assessment instrument for gauging AI effects in higher education. Employing various analytical methods, including Exploratory Factor Analysis, Confirmatory Factor Analysis, and Rasch Analysis, the initial 70-item instrument covered seven constructs. Administered to 635 students at Nueva Ecija University of Science and Technology – Gabaldon campus, content validity was assessed using the Lawshe method. After eliminating 19 items through EFA and CFA, Rasch analysis confirmed the construct validity and led to the removal of three more items. The final 48-item instrument, categorized into learning experiences, academic performance, career guidance, motivation, self-reliance, social interactions, and AI dependency, emerged as a valid and reliable tool for assessing AI's impact on higher education, especially among college students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.10.2.997
Pages: 197-211
cloud_download 8
visibility 42
0
Article Metrics
Views
8
Download
42
Citations
Crossref
0

Scopus
0

...